Sensitivity Analysis of Information Retrieval Metrics
نویسندگان
چکیده
منابع مشابه
Axiometrics: Axioms of Information Retrieval Effectiveness Metrics
The evaluation of retrieval effectiveness has played and is playing a central role in Information Retrieval (IR). A specific issue is that there are literally dozens (most likely more than one hundred) IR effectiveness metrics, and counting. In this paper we propose an axiomatic approach to IR effectiveness metrics. We build on the notions of measure, measurement, and similarity; they allow us ...
متن کاملThe Effect of Topic Sampling on Sensitivity Comparisons of Information Retrieval Metrics
The Voorhees/Buckley swap method is useful for comparing the discrimination power of Information Retrieval (IR) and Question Answering (QA) metrics. Given a test collection, a set of runs and an evaluation metric, it derives the swap rate, the chance of observing inconsistencies when two completely different topic sets are used for comparing a pair of runs. Recently, however, Sanderson and Zobe...
متن کاملNew Metrics for Sensitivity Analysis of FFANN
Abstract: An important issue in the design of a neural network is the sensitivity of its output to input and weight faults. In this paper, new fault metrics for sensitivity analysis is derived. The experimental derivation of the derived fault metrics is demonstrate that upper bound envelop exist with empirical error of the neural network. Correlation coefficient between MEANWSZ and derived sens...
متن کاملanalysis of reading comprehension needs of the students of paramedical studies: the case of the students of health information management (him)
چکیده ندارد.
15 صفحه اولDirect Maximization of Rank-Based Metrics for Information Retrieval
Ranking is an essential component for a number of tasks, such as information retrieval and collaborative filtering. It is often the case that the underlying task attempts to maximize some evaluation metric, such as mean average precision, over rankings. Most past work on learning how to rank has focused on likelihoodor margin-based approaches. In this work we explore directly maximizing rank-ba...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International Journal of Computer Science and Information Technology
سال: 2015
ISSN: 0975-4660,0975-3826
DOI: 10.5121/ijcsit.2015.7404